Generalized continuous isotonic regression
نویسندگان
چکیده
The standard isotonic regression of a vector in IRn is the solution to a least squares projection problem on the cone C of vectors with ‘increasing components’ in IRn. Generalized isotonic regression problems are isotonic optimization problems that seem to be quite different from isotonic regression problems, but in fact have the same solution. In problems of maximum smoothed likelihood estimation, often continuous versions of generalized isotonic regression problems emerge. In this paper we show that the solutions to such problems are often given by the relatively simple continuous isotonic regression of a function. We illustrate the result using the problem of maximum smoothed likelihood estimation of an increasing hazard function.
منابع مشابه
The Isotron Algorithm: High-Dimensional Isotonic Regression
The Perceptron algorithm elegantly solves binary classification problems that have a margin between positive and negative examples. Isotonic regression (fitting an arbitrary increasing function in one dimension) is also a natural problem with a simple solution. By combining the two, we get a new but very simple algorithm with strong guarantees. Our ISOTRON algorithm provably learns Single Index...
متن کاملA Fast Scaling Algorithm for Minimizing Separable Convex Functions Subject to Chain Constraints
In this paper, we consider the problem of minimizing j j j N C (x ) ∈ ∑ , subject to the following chain constraints l ≤ x1 ≤ x2 ≤ x3 ≤ ... ≤ xn ≤ u, where Cj(xj) is a convex function of xj for each j ∈ N = {1, 2, ..., n}. This problem is a generalization of the isotonic regression problems with complete order, an important class of problems in regression analysis that has been examined extensi...
متن کاملAn Alternative Unimodal Density Estimator with a Consistent Estimate of the Mode
The traditional maximum likelihood unimodal density estimator (Grenander (1956)) pieces together two isotonic density estimators at a known mode. It is discontinuous at the mode, and does not directly adapt to the case of unknown mode. This paper presents an alternative unimodal density estimator in the form of a generalized isotonic regression on a partial order which is continuous at the mode...
متن کاملGeneralized smooth monotonic regression
Common approaches to monotonic regression focus on the case of a unidimensional covariate and continuous dependent variable. Here a general approach is proposed that allows for additive and multiplicative structures where one or more variables have monotone influence on the dependent variable. In addition the approach allows for dependent variables from an exponential family, including binary a...
متن کاملIsotonic Regression under Lipschitz Constraint
The pool adjacent violators (PAV) algorithm is an efficient technique for the class of isotonic regression problems with complete ordering. The algorithm yields a stepwise isotonic estimate which approximates the function and assigns maximum likelihood to the data. However, if one has reasons to believe that the data were generated by a continuous function, a smoother estimate may provide a bet...
متن کامل